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1 Introduction and main results 



Let Xi, i = 1, 2, . . ., be i.i.d. random variables with the distribution P{Xi = 1) = P{Xi = —1) = 1/2 
and put 5o := 0, 5^ := Xi + . . . + Xj, i = 1, 2, . . .. Define the local time process of this simple 
symmetric random walk by 

^(/c, n):=#{i: l<i< n, Si = k}, A; = 0, ±1, ±2, . . . , n = 1, 2, . . . (1.1) 

We can also interpret £,{k,n) as the number of excursions away from k completed before n. 
We now define some related quantities for further use. Let po := and 

Pi := mm{j > -.3^ = 0}, i = 1,2, . . . , (1.2) 

i.e., Pi is the time of the i-th return to zero, or, in other words, the endpoint of the i-th excursion 
away from 0. We say that {Sa, Sa+i, • • • , Sh) is an excursion away from k, if Sa = = k, Si ^ k, a < 
i < b. This excursion will be called upward if Si > k, a < i < b and downward if Si < k, a < i < b. 
Define pf as the endpoint of the i-th upward excursion away from 0, and let ^{k, n, j) be the number 
of upward excursions away from k completed up to time n. Similarly, let ^(/c,n,|) be the number 
of downward excursions away from k completed up to time n. 

Let {W{t), t > 0} be a standard Wiener process and consider its two-parameter local time 
process {r]{x,t), x £ R, t > 0} satisfying 

/ 7](x, t)dx = X{s: 0<s<t, W(s) £ A} (1.3) 
J A 

for any t > and Borel set A C R, where A(-) is the Lebesgue measure. In the sequel we simply 
call r]{-, •) a standard Brownian local time. 

The study of the asymptotic behaviour of the centered local time processes (,{k, n) — ^(0, n) and 
r/(x, t) — r]{0, t) has played a significant role in the development of the local time theory of random 
walks and that of Brownian and iterated Brownian motions. The first of this kind of results we 
have in mind is due to Dobrushin [T^. Namely, in this landmark paper, a special case of one of his 
theorems for additive functionals of a simple symmetric random walk reads as follows. 

Theorem Al For any k = 1,2, . . . 

£(k,n) - e(0,n) r— , , 

where U and V are two independent standard normal variables. 
Here and in the sequel — >rf denotes convergence in distribution. 

On the other hand, concerning now centered Brownian local times, a special case of a more 
general fundamental theorem of Skorokhod and Slobodenyuk [34], that is an analogue of Dobrushin's 
theorem as in [17], yields the following result. 
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Theorem Bl For any x > 



r]{x,t) -r]{0,t) rrATTl" . _ r.\ 

2a;i/2^i/4 'dU^\V\, t^oo, (1.5) 

where U and V are two independent standard normal variables. 

While these two theorems are similar, we call attention to their intriguing difference in their 
scaling constants. For example, the respective scaling constant for A; = x = 1 is 2^2 in Theorem 
Al and it is 2 in Theorem Bl. 

Dobrushin's result as in [T^ was extended under various conditions by Kesten [25], Skorokhod 
and Slobodenyuk [35], Kasahara [23], [24] and Borodin [5j. For some details on the nature of these 
extensions we refer to the Introduction in |11| . 

In connection with the analogue of (II. 4p as spelled out in (|1.5p . for further extensions along 
these lines we refer to Papanicolaou et al. [29], Ikeda and Watanabe [21] and the survey paper of 
Borodin [6]. For some details we again refer to [TT] . 

The papers mentioned in the previous two paragraphs, in general, are concerned with studying 
additive functional of the form An := J27=if{^i)^ ^i^d their integral forms It := Jq g(W{s)) ds, 
where /(x), x £ R, and g{x), x £ R, are real valued functions satisfying appropriate conditions. 
In particular, Csaki et al. [TT] deals with strong approximations of these two types of additive 
functional, together with their weak and strong convergence implications. 

In view of (II. 4p and (|1.5p above, we now mention some corresponding iterated logarithm laws. 
For example, (4.1a) of Csaki et al. flT] yields 

Theorem CI For k = 1,2, . . . we have 

hmsup- , ,„ ,, , rTTTT = -0 ' a.s. l.o 

n^oo (4A;-2)V2ni/4(ioglogn)3/4 3 ^ ^ 

While studying the local time process of a symmetric random walk standardized by its local 
time at zero, Csorgo and Revesz [16] established the next result. 



Theorem C2 For k = 1,2, . . . we have 



,. g(fc,n) -^(0,n) 

hmsup—- , ,„ — ; —-jrr = 2' a.s. 1.7 

n^oo^ (4fc- 2) 1/2(^(0, n) log log n) 1/2 ^ ' 



Moreover, Theorem 1 of Csaki and Foldes [13] yields the next pair of Theorems. 
Theorem Dl For x > we have 

r]{x,t) - r]{0,t) 2 

hmsup — , ,„ ,, , r^TTT = -t> ' a.s. Lb 

t^oo 2xV2ti/4(ioglogt)3/4 3 ^ 
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and 

Theorem D2 For x > we have 

limSUp ^ ; TTTT = 2 ' a.s. (1.9) 

While these two pairs of theorems are similar, just like in case of (|1.4|) and (11.5(1 . we call attention 
to their intriguing difference in their scaling constants. 

In view of Theorems C2 and D2, we state the next two results. 

Theorem A2 For k = 1,2, . . . we have 

e(A:,n)-C(0,n) 

i U, n ^ oo, (1-10) 



(4/fc- 2)1/2(^(0, n))i/2 

where U is a standard normal random variable. 
Theorem B2 For x > we have 

rj{x,t)-r]{0,t) 



U, t^oo, (1.11) 



2a;i/2(ry(o,f))i/2 

where U is a standard normal random variable. 

Theorem A2 is argued intuitively on p. 90 of Csorgo and Revesz p£j, and it can be rigorously 
based on our results in Csaki et al. [11], while Theorem B2 is stated as one of the consequences of 
our results in Csaki et al. |10| . 

The next weak convergence result for fixed k follows from Kasahara [23] . 

Theorem E For k = 1,2,. . . we have 

e(fc,[At])-g(0, [At]) 

(4fc-2)V2Ai/4 ^(^(0'*))' ^ - 

where ??(•,•) is a standard Brownian local time, independent of the Wiener process W{-). 

Here and in the sequel denotes weak convergence in the respective function spaces in hand 
(here D[0,oo)). 

Moreover, for fixed x the next weak convergence result in C[0, oo) follows from Papanicolaou et 

al. m\. 



W{?iiO,t)), A^oo, 



Theorem F For x > we have 

r]{x,Xt) -r]{0,Xt) 
2xV2Ai/4 

where rj{0, t) is as in Theorem E. 
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When our paper [11] on strong approximations of additive functionals is interpreted in our 
present context, its general results also imply strong approximations for (,{k,n) — ^(0, n) when k is 
fixed, as spelled out in the next theorem. 

Theorem G On an appropriate probability space for a simple symmetric random walk {Si, i = 
0,1,...}, for any k = 1,2,..., we can construct a standard Wiener process {W{t), t > 0} and, 
independently of the latter, a standard Brownian local time {rj{0,t), t > 0} such that, as n ^ oo, 
with sufficiently small e > we have 

^{k,n)-C{0,n) = {Ak-2)^/^W{rj{0,n))+O{n^/'^-') a.s. (1.12) 

and 

^(0,n) -^(0,n) = 0(n^/2"^) a.s. (1.13) 



Following the method of proof of Theorem 2 in Section 3 of |llj, one can also establish the next 
theorem, which is also a consequence of our Theorem in [TO], that is quoted below (cf. Theorem J). 

Theorem H On an appropriate probability space for the standard Brownian local time process 
{r]{x,t), X €z R, t > 0} of a standard Brownian motion, for any x > 0, we can construct a standard 
Wiener process {W{t), t > 0} and, independently of the latter, a standard Brownian local time 
{rj{0,t), t > 0} such that, as t ^ oo, with sufficiently small e > we have 

ri{x,t) -7]{0,t) =2x^/'^W{?j{0,t)) + 0(t^/'^"^) a.s. (1.14) 

and 

?7(0,t) -^(0,t) = 0(t^/2~^) a.s. (1.15) 



A common property of the above quoted theorems is that they treat the two-time parameter 
processes S,ik,n) and rj{x,t) for k, respectively x, fixed, i.e., as if they were one-time parameter 
stochastic processes. (In (|1.12p . resp. (I1.14p . both W and the O term may depend on k, resp. x.) 
Clearly, studying them as two-time parameter processes is of cardinal interest. A significant first 
step along these lines was made by Yor [38], who established the following weak convergence result. 

Theorem I ^ds A ^ cxd, 

Q.W{Xh), ]-rj{x, Xh), ^{riix, XH) - r?(0, XH))^ 

{W{t),r,{x,t),W*{x,v{0,t))), 

where W*{-,-) is a Wiener sheet, independent of the standard Wiener process W{-), '!]{•,•) is the 
local time of W{-), and -^w denotes weak convergence over the space of all continuous functions 
from to i?^, endowed with the topology of compact uniform convergence. 
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By a Wiener sheet we mean a two-parameter Gaussian process 



{W{x,y),x>^,y>^] 

with mean and covariance function 

EW{xi,yi)W{x2, y2) = {xi A X2){yi A ^2) 

(cf., e.g., Section 1.11 in Csorgo and Revesz [15j). 

In Csaki et al. [10] we proved the following strong approximation of Brownian local time by a 
Wiener sheet. 

Theorem J On an appropriate probability space for the standard Brownian local time process 
{rj{x,t), X £ R, t > 0} of a standard Brownian motion, we can construct a Wiener sheet {W{x,u), 
x,u>0} and, independently of the latter, a standard Brownian local time {rj(0,t), t > 0} such that, 
as t 00, for sufficiently small e > there exists 6 > for which we have 

sup \r]{x,t) -r]{0,t) -2W{x,^{0,t))\ = 0{t^^'^~') a.s. 

0<x<t^ 

and 

r/(0, t) - J]{0, t) = 0(t^/2"^) a.s. 



In Csaki et al. [10] we also proved the analogue of Theorem J for t replaced by the inverse local 
time a(-) defined by 

a(n) := inf{t > : rj{0,t) > u}. 

Proposition A On an appropriate probability space for the standard Brownian local time pro- 
cess r]{x,t), X £ R, t > 0} of a standard Brownian motion, we can construct a Wiener sheet 
{W{x,u), x,u > 0} and, independently of the latter, an inverse local time process {a{u), u > 0} 
such that for sufficiently small e > there exists 6 > for which as u ^ 00, we have 

sup \r]{x,a{u)) -u-2W{x,u)\=0{u^^'^^'^) a.s. 

0<1<M'' 

and 

a{u) — a{u) = 0{u^~^) a.s. 

Concerning weak convergence of increments of random walk local time, Eisenbaum [19] estab- 
lished a two-parameter result for symmetric Markov chains at inverse local times, which for a simple 
symmetric random walk reads as follows. 

Proposition B A ^ 00, 
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where {G{k, t),k = 1,2, t > 0} is a mean zero Gaussian process with covariance 

EG{k, s)G{£, t) = {sA t){4{k M) - li^^^j - 1), 

where weak convergence is meant on the function space D that is defined in Section 2.1 below. 

In view of Theorem J and Propositions A, B the present paper estabhshes several strong ap- 
proximation results in a similar vein for random walk local times, appropriately uniformly in k, in 
both of the cases when the time is random or deterministic. 

In the next three theorems we study the asymptotic Gaussian behaviour of the centered two-time 
parameter local time process {^{k, n) — ^(0, n), A: = 0, 1, . . . , n = 1, 2, . . .} via appropriate strong 
approximations in terms of a Wiener sheet and a standard Brownian motion. 

Theorem 1.1 On an appropriate probability space for a symmetric random walk {Sj, j = 0,1, . . .}, 
we can construct a Wiener sheet {W{x,y), x > 0,y > 0} and, independently, a standard Brownian 
motion {W*{y), y > 0} such that, as n ^ oo, with e > we have 

^{k, n) - ^(0, n) = G{k, e(0, n)) + 0{k^/^n'^/^+^'/^) a.s. (1.16) 

where, for a given e > 0, the O(-) term is uniform in k E [l,n^/^~^] and 

G{x,y):=W{x,y)+W{x-l,y)-W*iy), x>l,y>0. (1.17) 

The just introduced notation in (I1.17P for G(-,-) will be used throughout this exposition. We 
note that it is in fact the same process as that of Proposition B, i.e., the two Gaussian processes 
agree in distribution, but here G{-,-) is to be constructed of course, and so that we should have 
(|1.16|) holding true. 

It will be seen via our construction of W{-,-) and W*{-) for establishing (I1.16P that C(0,n) 
cannot be independent of the latter Gaussian processes. This, in turn, limits its immediate use. For 
the sake of making it more accessible for applications, we also establish the next two companion 
conclusions to Theorem 1.1. 

For further use we introduce the notation =d for designating equality in distribution of appro- 
priately indicated stochastic processes. 

Theorem 1.2 The probability space of Theorem 1.1 can be extended to accommodate a random 
walk local time ^(0, n) such that 

(i) {e(0,n), n = l,2,...}=rf{e(0,n), n = l,2,...}, 

(ii) C(0, •) is independent of G{- , ■) 

and, as n ^ oo, with e > we have for some 6 > 

(iii) ^(0, n) - ^(0, n) = 0{n^/^~^) a.s.. 
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(iv) ^{k,n)-mn)=G{k,aO,n)) 
where, for a given e > 0, the latter O(-) term is uniform in k G [l,n^/^~^]. 

Theorem 1.3 The probability space of Theorem 1.1 can be extended to accommodate a standard 
Brownian local time process {ry(0, t), t > 0} such that 

(i) 7/(0,-) is independent ofG{-,-) 

and, as n ^ oo, with e > we have for some S > 

(ii) C(0, n) - ?7(0, n) = 0(nV2-'5) a.s., 

(iii) C{k,n)-mn) = G{k,rjiO,n)) 

+0(fc5/4^1/8+5£/8 + ^„l/6+£/4 + ^1/2^1/4-5) ^^^^ 

where, for a given e > 0, the latter O(-) term is uniform in k G [1,71,"'^/^^'^]. 

The proofs of the above theorems will be based on the following propositions. 

Proposition 1.1 On an appropriate probability space for the symmetric random walk {S^, k = 
1,2, . . .} one can construct a Wiener sheet {W{-, •)} such that as N ^ oo, with £ > we have 

m T) - ^(0, P%A) = W{k, 27V) + 0(A:^/4ArV4+^/2) a.s., (1.18) 

where, for a given e > 0, the O term is uniform in k G [1, N^^^~^). 

Proposition 1.2 The probability space o/ Proposition 1.1 can be so extended that as N ^ oo, with 
e > and G(-, •) as in Theorem 1.1 we have 

C(A;,P^) -^(0,p+) = G(A;,2Ar) +0(A:5/47vV4+./2) a.s., (1.19) 
where, for a given e > 0, the O term is uniform in k E [1,N^^^~^). 

Proposition 1.3 On the probability space o/ Proposition 1.1, as N ^ oo, with e > we have 

^{k, pn) - m Pn) = G{k, N) + 0(A;5/^ivV^+^/2) a.s., (1.20) 

where for a given e > 0, the O term is uniform in k E [IjN^^^"^). 

Prom now on the outline of this paper is as follows. In Section 2 we mention and prove some 
consequences of our just stated theorems and propositions. In Section 3 we collect preliminary 
results that are needed to prove these theorems and propositions. Theorem 1.1 and Propositions 
1.1-1.3 are proved in Section 4, while Theorems 1.2 and 1.3 in Section 5. 
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2 Consequences 

Here we establish a few consequences of our theorems and propositions, concerning weak convergence 
and laws of the iterated logarithm. 



2.1 Weak convergence 

We start with convenient strong approximations for the sake of concluding corresponding weak 
convergence. 

Theorem 2.1 Let ^(•, •), r/(-, and G{-, •) be as in Theorem 1.3. As X ^ oo, we have 



max sup 

l<k<K o<t<T 



and 



max sup 

l<k<K o<t<T 



AV4 AV4 
^ik,p[x^)-Xt G{k,Xt) 



a.s. 



Ai/2 



AV2 



a.s. 



(2.1) 



(2.2) 



for all fixed integer K > 1 and T > 0. 



Proof. In view of Theorem 1.3 and Proposition 1.3 the respective statements of (|2.ip and (|2.2p are 
seen to be true. □ 

Let A^"*" := [1, 2, . . .), and define the space of real valued bivariate functions 

f{k,t) £D := D{N+ X [0,oo)) 
that are cadlag in t G [0, oo). Define also 

A = A(/i,/2)= max sup \Mk,t) - f2{k,t)\ 

l<k<K o<t<T 

with any fixed {K,T) £ x [0,oo), and the measurable space (Z),I?), where V is the ci-field 
generated by the A-open balls of D. 
On account of having for each A > 

| G(M(0,At)) ^ (fc,t) G iV+ X [0,oo)| =, {G{kMO,t)), {k,t) G iV+ X [0,oo)} 



and 



{k, t)eN+x [0, oo)| =d {Gik, t), {k, t)GN+x [0, oo)}, 
Theorem 2.1 yields the following weak convergence results. 
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Corollary 2.1 Let ^(-j •), r){-, ■), and G(-, ■) be as in Theorem 1.3. As X ^ oo, we have 
and 

for all h : D ^ R that are iD,T>) measurable and IS.- continuous, or A-continuous except at points 
forming a set of measure zero on {D,T>) with respect to G{-, ■), over all compact sets in T>. 

2.2 Law of the iterated logarithm 

Theorem 2.2 Let K = K(t), t > be an integer valued non- decreasing function oft such that 
K{t) > 1 and 

lini liin — - — = 1 

If K{N) < A^Vs-e foj, 5ome £ > 0, then 

T SUp^<k<K\^ik,PN) - N\ /OQN 

limsup- - ,„ , — ; — ; -77- = 2 ' a.s. (2.3) 

JV-.00 (4i^ - 2) V2 ( AT log log iV) 1/2 ^ ' 



If, however, K{n) < v}/^ ^ for some £ > 0, then 

iimsup- ~ ~, ,„ , .. , = 1:^ a.s. 2.4 

n-.oo (4K-2)V2ni/4(loglogn)3/4 3 ^ ' 

The proof of Theorem 2.2 is based on the following result. 
Lemma 2.1 For any a > 1, K >1, t > Q we have the following inequalities: 

P| max sup |G(A;,s)| > u I (2.5) 

\l<k<KQ<s<t' ) 



< Cexp ( , u > 0, 

^\ 2at{4.K - 2) y ' 



P{ max sup \G{k,s)\>u\ (2.6) 



l<fc<if 0<s<»7(0,t) 



with a certain positive constant C depending on a. 
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Proof. Consider the process {Y{s) = maxi<k<K Gik, s), s > 0}. Y{s) is a submartingale with 
respect to J-'s, the sigma algebra generated by G{k,u), l<k<K,0<u<s, since if /cq is defined 
by G{kQ,s) = maxi<k<K G{k, s), then obviously 



and 

Consequently, 
and for A > 



EiGiko,t)\J^s) = Giko,s) 
E{Y{t) I > E{G{ko,t) I = G{kQ,s) = Y{s). 



sup max Gik, s), t > 

Q<s<t^<k<K 



sup max exp(AG(A;, s)), t > 

0<s<t^<k<K 



are submartingales. Using Doob inequalities (twice) we get 



P sup max Gik, s) > u 

\0<s<ti<k<K J 



P[ sup max exp(AG(A:, s)) > exp(Ati) 

\0<s<tl<*:<^ , 



< e"^"^ (^^max^exp(AG(/c,t)^ 



- [dr~[) e"^"^(exp(QAG(i^,t))) (2.7) 
for any a > 1. G{K,t) has normal distribution with mean zero and variance (AK — 2)t, hence 

^(exp(aAG(i^, t))) = exp I (4-?^ - 2)t J 

and putting 

d2(4^_2)t' " " 



into (1221), we get fMl). 

On the other hand, if 77(0, •) is a Brownian local time, independent of G(-, •), we get from (12.71) 
p{ sup max G(A:,s) > n) < C7e"^"^(exp(QAG(i^,7?(0,i)))). 

\0<s<r,{0,t) ^<k<K J 
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But 

(4i^ _ 2)1/2^1/4 -'^^il^^l , 
where Mi and M2 are independent standard normal variables. Hence 

P I max sup G{k,s) > u] < Ce-^^'E {^^\N2\{^K - 2)t^l'^\ 

\l<fc<i^ 0<s<r?(0,i) / V ^ / 

Putting A = {2u)^/^a-'^/^{AK - 2)-2/3t-i/3^ ^ ^ ^4/3^ j2j|). □ 

Proof of Theorem 2.2. Let = a^, a > 1. Putting 

u = {2a\AK{t^) - 2)tt\og\ogU)^/\ t = t^,K = K{ti) 

into (|2.5p . using Borel-Cantelli lemma and interpolating between and t^, the usual procedure 
gives for all large t 

max < a3/2(2(4i^-2)tloglogt)i/2_ (2.8) 

i<fc<A' 

By Proposition 1.3 we also have for large N 

max \i{k,pN) -N\< a^''^{2{AK - 2)N loglogNf''^ + 0{K^/^N^/^+^'/^). 

l<k<K 

Since 

hm —7^ = 0, 

iv^oo (/riVloglogAr)i/2 

a K < A^^/^^^, and a > 1 is arbitrary, we have an upper bound in (12. 3p . 
The upper bound in (|2.4I) is similar. Put 



U = 25/43-3/4«3/2(4^ _ 2)V2il/4(i„gi„g^)3/4 



into (I2.6|l . Then, as before, we conclude that almost surely 

max \G{k,rj{0,t))\ < aH^I^T^I^{AK - 2)^l^t^l^{\oz\ogtfl^ 

l<k<K 

for t large enough. Since a > 1 is arbitrary, using Theorem 1.3, we get an upper bound in (|2.4I 
To prove the lower bound in (|2.3I) . for < (5 < 1 define the events 

Ae = {G{Ke,te) - G{Ke,k_i) > (1 - <5)(2(4K, - 2)t,loglogt,)i/2}, 
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£ = 1,2, . . ., where te = 6 ^ and Kg = K{ti). Since G{K^, te) — G{Ki, te-i) has normal distribution 
with mean zero and variance {4:K£ — 2){ti — an easy calculation shows 



Since are independent, Borel-Cantelli lemma implies P(^^i.o.) = 1. But 

G{Ke,te^i) < {l + S){4Ke - 2)i/2(2i,loglogt,)V25i/2 
for all large i, we have also 

G{K,,te) > ((1 - 5) - (1 + 5)5i/2)(2(4K, - 2)t,loglogt,)i/2 

infinitely often with probability 1. Since 5 > is arbitrary, we conclude 

G(K,t) 

limSUp— ^ — -777 > 1. 

t-.oo (2(4K-2)tloglogt)V2 - 



Using Proposition 1.3, this also gives a lower bound in (|2.3h . 

To show the lower bound in (|2.4p . we follow Burdzy [Sj with some modifications. Define 
exp(£log^), and the events 

= {(1 - 5)ai < r^{U) < 2(1 - 5)a^} 

and 

Af = {inf G{K,,s) - G{Ke,-fa,) > (1 - 2/3)(4i^, - 2)V2^,}, 

sell 

where = K{ti,), 7]{ti) = r/(0,t^), 

/2 

ai= [ log log i 
2 

= sTTa'^^-'^ ~ 25)af logloga;?)^/^ 

= [(l-25)af,3(l-2,5)a^], 

and f3, 6, 7 are certain small constants to be choosen later on. Obviously, the events {^^^\ 
(2) 

1,2, . . .} and {A), , ^ = 1,2, . . .} are independent. Let 

A = 4^Af\ 

We show that for certain values of the above constants, P{Aii.o.) = 1. 
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— 1/2 

Since 'ni'^i) is distributed as the absolute value of a standard normal variable, an easy 
calculation shows 

> — ^ — 



(logt,)(l-5)/3 

with some C > 0. 

Converting the inequality of Lemma 2 in Burdzy ^ from small time to large time, the following 
inequality can be concluded for large enough u: 

P{ inf W{s) - W{-iu) > (1 - 2/?)(2/3^/2)('uloglogu)^/2) 

s£[n,3n] 

> (logn)(-2/3)(i-/^)/(i-^), 
where W{-) is a standard Wiener process. Prom this we get 



P{AY') > 



(logn^)2(l-/3)/(3(l-7)) 

with C > 0. 

We can choose the constants l3,^,S appropriately to have J^iPi^i) = J2i P{A^l^)P{Af'^) = oo. 
The events Ai however are not independent. Next we show P{AjA£) < CP{Aj)P{A£) with some 

(2) 

constant C. It can be seen that for large i we have 3(1 — 26)ai < 70^+1, therefore A^ are 
independent events for i > £0 with a certain io. We have 

P{AjAe) = P{Af^Af^)P{Af)P{Af). 

It suffices to show that P{A^p A^p) < CP{A^^^)P{Af'^). For this purpose it is more convenient 
to work with M{t), the supremum of the Wiener process, since according to Levy's theorem, the 
process {r?(0,t), t > 0} is identical in distribution with {M{t), t > 0}. So let {W{t), i > 0} be a 
standard Wiener process and M{t) = supo<s<t Denote by gt{y) the density of M{t) and by 

fl'ti,t2 (yi' 2^2) the joint density of M{ti),M{t2) ■ It is well known that 

Then with h{ti,z), the joint density of M{ti) and W{ti), we can write for ti < t2, 

ryi 

ghMivi^Vi) = / Hti,z)gt2~h{y2 - z)dz. 
J —00 

It can be seen that for z < yi 



, ^ t2 , . f ym 
gt2-ti (2/2 - z) < \ —51*2 {y2) exp 



t2 — tl \t2 — h 
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Hence 



Returning to the probability of the events A^^^ , we have for j < £ 



where C > 1 can be choosen arbitrarily close to 1 by choosing £ — j sufficiently large. Hence for any 
e > there exists tuq such that 

P{A,Ae) < {l+e)P{A,)P{Ae) 

if ^ — j > n^o ■ It follows that 

n £ n £—mo n 

1=1 3=1 i=l j=l 1=1 

By Borel-Cantelli lemma (cf. [36], P- 317) P(^£i.o.) > 1/(1 + e). Since e > is arbitrary, we also 
have Pi^Ai'x.o}) = 1. A^^^ implies 

V{te) G [{l-6)ai,2{l-6)ai] C k, 
consequently, if both A^f^^ and Af'^ occur, then 

> (1 - 2(3)i4Ke - 2)i/22((i _ 25)a£ log log 0^)^/2/3'/' + G(K^7af). 
It follows from JISl) that 

G{Ki,-fai) > -(4i^^ -2)1/2 (7a^ log log 0^)1/2 
for all large i with probability 1, i.e. 

UK 9wfrt'^1 V/2 ^ (1 - - 25)^/^2/3^2 - 7V2. 

C^oo (4K£ - 2)V2(a^iogloga£)v2 

But 

lim , = (2/3)V2, 

4 (log log *^)^/^ 
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implying 

maxi<fc<j^ G{k,ri{0,t)) 
™'o^P i4K - 2)i/2ti/4(ioglogt)3/4 

> 25/^3-3/4(1 - 2/3)(l - 25)^/2 - 2V43-i/4y/2 

Since it is possible to choose /3, 5, 7 arbitrarily small, combining this with Theorem 1.3, gives a lower 
bound in ^M- □ 



3 Preliminaries 

In this Section we collect the results needed to prove our theorems and propositions. The proofs 
will use the branching property (Ray-Knight description) of the random walk local time. For more 
details in this respect we refer to Knight [26|, Dwass |18j, Rogers [32j and Toth |37j. 
Introduce the following notations for /c = 1, 2, . . . , i = 1, 2, . . .. 

rf ^ := min{i > t^^ : Sj^i = k,Sj = k- 1}, (3.1) 
there is such 

1,2,..., fc = l,2,... 



with 4''^ := 0, 

With probability 1, there is such a double infinite sequence of t^^^ and hence also of T^'''^ 



(k) 

Lemma 3.1 The random variables {T^ , /c = 1, 2, . . . , i = 1, 2, . . .} are completely independent and 
distributed as 

P(Tf)=i) = l j = l,2,..., (3.3) 
^(rf ^) = 2, Var{T^''^) = 2. (3.4) 



Proof. Obvious. 
Introduce 



t/('=)(i):=rf^ + ... + rf^-2j, A: = l,2,..., j = l,2,... . (3.5) 
For the following inequality we refer to Toth |37|. 
Lemma 3.2 



P ( ^nia^ |f7('=)(i)| > < 2exp ( -|- j , 0<z<aon 



for some oq > 0. 



We need Hoeffding's inequality [20] for binomial distribution (cf. also Shorack and Wellner [33 
pp. 440). 
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Lemma 3.3 Let have binomial distribution with parameters (A^, 1/2). Then 

P{\2uN -N\>u) <2eicp(^-^Y ^ < ^■ 

To establish our results, we make use of one of the celebrated KMT strong invariance principles 
(cf. Komlos et al. [28]). 

Lemma 3.4 Let {Yi}^-^ be i.i.d. random variables with expectation zero, variance and having 
moment generating function in a neighbourhood of zero. On an appropriate probability space one 
can construct {1^}^^ and a Wiener process t > 0} such that for all x > and n = 1,2, . . . 



P I max 

l<i<n 



> Cilogn + x < Cae-^^x, 



where Ci,C2,C^ are positive constants, and C3 can be choosen arbitrarily large by choosing Ci 
sufficiently large. 

There are several papers on strong invariance principles for local times, initiated by Revesz ^30j . 
and further developed by Borodin [5], [6], Bass and Khoshnevisan [2], and others, as in the references 
of these papers. The best rate via Revesz's Skorokhod type construction was given by Csorgo and 
Horvath [H]. 

Lemma 3.5 On a rich enough probability space one can define a simple symmetric random walk 
with local time ^{■, ■) and a standard Brownian local time r]{-, •) such that as n ^ 00 



sup \^{k,n) — r]{k,n)\ = 0(n"'^/^(log n)^/^(log log n)"*^/^) a.s. 



(3.6) 



We note in passing that having (|3.6p with 0(n^/^(loglogn)^/^) is best possible for any construc- 
tion (cf. Csorgo and Horvath [Bj), i.e., only the (logn)^/^ term of (|3.6p could be changed, and only 
to (log log n)^/^, by any other construction. It remains an open problem to find such a construction 
that would achieve this best possible minimal gain. 

Lemma 3.6 Let {VFj(-), i = 1, . . . , k} be independent Wiener processes and t > 0. The following 
inequality holds. 



sup 

,0<U<t,i=l,...,k 



1=1 



> z 



< 2A:e-^'/(2fc2*), 



< z. 
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Proof. Since 



we have 



sup 

0<U<t,i=l,...,k 



4 = 1 



< k max sup , 

i<i<fco<ti<t 



P sup 

\0<U<t,i=l,...,k 



i=l 



> z] < P{ max sup \Wi{ti)\ > z/k 

I \^<i<ko<ti<t J 



<kp( sup \W{s)\ > z/k] < 2A:e~"'/(2fc2*). 

\0<s<t J 



□ 



Lemma 3.7 The following identities hold. 

C{k, p+ ) = U^"^ iC{k - 1, p+ , t)) + 2C{k -l,p%,]), 
C(fe-i,P+,T) 

i=l 



(3.7) 

(3.8) 
(3.9) 



Proof. Obvious. 

Equation (|3.8p amounts to saying that ^{k, p'j^,^), A; = 0, 1, . . . is a critical branching process 
with geometric offspring distribution. 



Lemma 3.8 For K > 1 



P{ max ^{k, p+) >5N)<K exp . ^ , 



(3.10) 



Proof. For the distribution of (,{k,pf) we have (cf. Revesz |31| ) 



pm,pt 



m) 



2fc^ V 2A: 



if m = 0, 



m—l 



if m=l,2 

Hence for the moment generating function we have 

MkA)^ _ l-(2/c-2)(l-e-* 



(3.11) 



g{k,t) = E(^e 
Selecting t = 1/(4K), we arrive at 



1 - 2A;(1 - e- 



< 1 + 



2t 



1 - 2kt 
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Since 

we have by Markov's inequality 



□ 

We need inequalities for increments of the Wiener process (Csorgo and Revesz [E]), Brownian 
local time (Csaki et al. [9]), and random walk local time (Csaki and Foldes |12j). 

Lemma 3.9 With any constant C2 < 1/2 and some Ci > we have 



P sup sup 

\0<s<T-feO<t< 



i \W(s + t)- W(s)\ > vVh] < ^^e- 
h / 

sup {viO,h + s)-rj{0,s))>xVh]<Ci(-] e^^^^' 



and 

pf max {^{0,a + j)-aO,j))>xV^)<Ci(-) e"^^-'. 

\0<3<t-a J \a/ 

Note that we may have the same constants Ci,C2 in the above inequalities. In fact, in our proofs 
the values of these constants are not important, and it is indifferent whether they are the same or 
not. We continue using these notations for constants of no interest that may differ from line to line. 



P{PN > uN^) < ^ 



Lemma 3.10 For 1 < u we have 
and 

E{pil{pi < u}) < 3^/u. 
Proof. For the distribution of pN we have (cf. Revesz ^31j, PP- 98) 

P{PN > 2n) = ^ J:2^ ^ 'j, n = l,2,.... 

An elementary calculation shows that the largest term in the sum above is for j = 0, hence 

N (2n\ 



P{PN > 2n) < 



n 
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Moreover, it can be easily seen that 

(2n + 2)V2 /2n\ 

is decreasing in n = 1, 2, . . ., hence it is less than 1 for all n, and thus implying 

N 



P{pN > 2n) < 



(2n + 2)V2- 

For a given u > 1 choose n so that 2n < uN^ < 2n + 2. Then 

> uN^) < > 2n) < < -1^ 

Moreover, 

E{pii{pi < u}) = jp{pi = j)< Yl Pipi>u) 

l<j<u 0<j<u 

1 f" dx 

<1+ V -y=<l+ -^ = 1 + 2Vu < 3V^^. 

□ 

Lemma 3.11 Define tq := 0, 

T„ := inf{t : t > r„^i, \W{t) - W{Tn-i)\ = 1}, n = 1, 2, . . . 
Then Tn is a sum of n i.i.d. random variables, E{ti) = 1 and 

E{e'-') = (3.12) 

Moreover, 

P{\Tn -n)\> nyn) < 2e-^"'/^ < u < 2V^/3. (3.13) 

Proof. For (I3.12p see, e.g., Borodin and Salminen [7]. To show (I3.13p . we use exponential Markov's 
inequality: 

P{\Tn - n| > u^) < e-"^v^ {{g{e)T + {9{-e)T) , 

for < 6* < 1/2, where 

g{e) :=j;(e^(-^-^)= ^ 

cosh(V26') 

By the series expansion of log cos x (cf. Abramowitz and Stegun [1], pp. 75) and putting coshx = 
cos(ix), we get 

log cosh X = > \ , , ' x^^, X < -, 
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where Bi are Bernoulli numbers, and using that i?2 = 1/6, -B4 = — 1/30 and the inequality (cf. [T], 
pp. 805) 

2(2n)! 



B2n\ < 



(27r)2"(l - 21-2") 



for n > 2, one can easily see that 



< 20^3 



if < 6* < 1/2. Similarly, 

log g{-e) < 29^/3, 0<9<l/2, 
hence putting 9 = 3u/{4^/n), we get (I3.13p . □ 

Lemma 3.12 Let 1^, i = 1,2,... be i.i.d. random variables having exponential distribution with 
parameter 1. Then 



P I max 

i<j<« 



Moreover, with any C > 0, 



j=0 



> u^/n < 2e-"'/^ < u < 2^/^. 



P ( max Yi > Clogn I < n^"*^. 



l<i<n 



(3.14) 



(3.15) 



Proof. By exponential Kolmogorov's inequality (see Toth [37]) we have for < < 1/2 



P I max 

l<i<n 



i=0 



> uWn 



<e-^"v^((/(0))" + (/(-e))"). 



where 



and, similarly. 



1) 



e<^{l-9) 



< e 



29^ 



Now (|3.14l) can be obtained by putting 9 = u/{4:^/n), and (|3.15|) is easily seen as follows. 



□ 



P { ^max^Fi > ClogiV ) < NP{Yi > ClogN) = N 



Finally, we quote the following lemma from Berkes and Philipp [3]. 



i-c 
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Lemma 3.13 Let Bi, i = 1,2,3 be separable Banach spaces. Let F be a distribution on Bi x B2 
and let G be a distribution on B2 x B^ such that the second marginal of F equals the first marginal 
ofG. Then there exists a probability space and three random variables Zi, i = 1,2,3, defined on it 
such that the joint distribution of Z\ and Z2 is F and the joint distribution of Z2 and Z3 is G. 



4 Proof of Theorem 1.1 
4.1 Proof of Proposition 1.1 

First we prove the next lemma, which is a consequence of Lemma 3.4. 

Lemma 4.1 On an appropriate probability space one can construct independent random variables 
{^/'^'*}rfc=i with distribution (|3.3p and a sequence of independent Wiener processes {Wk{t), t > 
such that, as N ^ oo, we have 

^max^ m.ax^|t/W(j) - Wk{2j)\ = O(logiV) a.s., (4.1) 



where U'^^\j) are defined by (13.5 

Proof. By Le 

Wfc satisfying 



(k) 

Proof. By Lemma 3.4 for each fixed A: = 1, 2, ... on a probabihty space one can construct and 



P { max \U'^^\j) - Wk{2j)\ > {Ci + l)logiV ) < C2e-^3iog7V_ ^4 2) 

(k) 

Note that the constants Ci, C2, C3 depend only on the distribution of , hence they do not depend 
on k. Now consider the product space so that we have (14.21) for all A; = 1, 2, . . . on it. Then 

P (^max^ m.ax^ \u'^''\j) - Wk{2j)\ > {Ci + 1) log N 



NC3-1 ■ 

Choosing C3 > 2, (14.11) follows by Borel-Cantelli lemma. □ 

Now on the probability space of Lemma 4.1 a Wiener sheet W{-,-) is constructed from the 
independent Wiener processes Wk, k = 1,2,... as above in such a way that for integer k we have 
(cf. Section 1.11 of p]) 

k 

W{k,y) = Y.Wdy). (4.3) 

i=l 

By Lemma 3.13 this can be extended to a Wiener sheet {W{x,y), x,y >0} on the probability 
space of Lemma 4.1, so that on the same probability space we have a simple symmetric random 
walk {Si}^Q as defined in the Introduction, satisfying (|3.ip and (|3.2p . 
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To show Proposition 1.1, we start from the identity 

ak, p^,]) = ak, ptj) - ak, Pti, i) = ^^'^ m - 1, p^, d) + ak - 1, Pti, t)- 

Repeating this procedure several times, we arrive at 

k 

^k, p+, T) = ^ c/« m - 1, p^, T)) + N. 

i=l 

For brevity, from here on in this proof we use the notation 

?i = CihPN,^)- 

Continuing accordingly, using Lemma 4.1 and the fact that as — > oo 

max log£i = OflogTV) a.s., 

l<j<Ari-e 

which follows from Lemma 3.8, we get for k = 1,2,... 

k 

6 = E WMi-i) + N + Oik logiV) 

i=l 

k 

= W{k,2N) +N + 0{klogN) + ^{Wi{2^i-i) - Wi{2N)) a.s. 

i=l 

Now we are to estimate the last term in our next lemma. 
Lemma 4.2 As N ^ oo, 

k 

Y,{Wi{2^i-i) - Wi{2N)) = 0(A;5/^ivV4+-/2) a.s., 

i=l 

where the O term is uniform in k E [1, N^^^"^]. 
Proof. Observe that 

k k 

Y,iWi{2^i-i) - Wi{2N)) =Y,Wii2\^i-i - N\), 

i=l i=l 

where Wi{-), i = 1,2, . . . are independent Wiener processes. 

Let K = Wk = fcl/2iVl/2+e/2^ ^ ^5/4^1/4+^/2^ Tl^gj^ 



'(Ml 



k 

Y,{Wi{2ii-r) - Wi{2N)) 

i=l 
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^T^,(2|e.-i-iV|) 



K 



k=l 



i=l 
k 



i=l 



> Zk 



K 



k=l 



sup 

0<ti<2wf; ,i=l,...,k 



i=l 



> Zk 



It follows from (|3.8p by telescoping that 

5i_i+5i_2+...6+A^ 



J2 iT,-2), i = l,2, 

(k) 



where T, are i.i.d. random variables distributed as T} . Prom Lemma 3.2 and Lemma 3.8 we obtain 



P max — N\>Wk 

.l<i<k 



< P max £i > 5N ] + kP \ max 

\l<i<k ) \ l<n<5Nk 

<A;e-^/(4fc)+2A:e"™i/(40fciV)_ 
Prom this, together with Lemma 3.6, we finally get 



E(^.-2) 



> Wk 



'(Hi 



Y.iWii2Ci-i) - Wii2N)) 



i=l 



> Zk 



< 



k=l 



< ^2/3g-Ar2/3+V4 _^ 2iV2/3g-A^V40 ^ 2iV2/3g-iV-'/V4^ 

This is summable in N, so the lemma follows by Borel-Cantelli lemma. □ 
Since C(0,p^,t) = A^, this also proves Proposition 1.1. □ 

4.2 Proof of Proposition 1.2 

According to (13. 9|) and Proposition 1.1, as — > cxd, 

= 2N + W{k, 2N) + W{k - 1, 2iV) + 0{k^/^N^/^+'^^) a.s. 



(4.4) 
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On the other hand, 

m p%) = m p%, T) + c(o, p%, i) = N+ c(o, p+ , i). (4.5) 

But 

e(0,p+,i)=r* + ...+T;^, (4.6) 

where T* represents the number of downward excursions away from between the ith and (i + l)st 
upward excursions away from 0. Hence T* are i.i.d. random variables with geometric distribution 

pin=j) = ^, j = o,i,2,... 

and also independent of {T^''\ i, /c = 1, 2, . . .}. Hence from KMT Lemma 3.4 and by Lemma 3.13, 
on the probability space of Proposition 1.1 one can construct a Wiener process W*{-), independent 
of W{-, •) such that, as ^ oo, 

+ ...T^ = N + W*{2N) + 0{\ogN) a.s. 

This together with (14. 4p . (|4.5|) and (|4.6[1 proves Proposition 1.2. □ 

4.3 Proof of Proposition 1.3 

Consider N excursions away from 0, out of which z/jy are upward excursions, and N — are 
downward excursions. According to Proposition 1.2, as — > oo, 

= G{k, Ivn) + 0{k^/^N'^/^+'/^) a.s. 
Since ^(A;,pAr) = S,{k,p'^^) for > 0, it is enough to verify the next Lemma. 
Lemma 4.3 As N ^ oo we have 

W{k, 2un) - W{k, N) = 0(fci/2^i/4+e/2) (4_7) 

where O is uniform in k £ [1, A^]- Moreover, 

W*{2iyN)-W*{N) = 0{N^/^+'/^) a.s. (4.8) 
aO,PN)-mpL) = 0{logN) a.s. (4.9) 
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Proof. 

N 



pi \J [\W{k,2uN) -W{k,N)\ > /tV2ivi/4+e/2| 

^ ^ / \W{k,2l.N)-W{k,N)\ ^ i/4+e/2\ 

NP {W{\2UN -N\)> iVi/4+£/2 



< 

< NP ( sup \W{u)\ > Ari/4+£/2 j + NP{\2uM - N\ > Ari/2+£/2) 

< 2Nexp{-N'^'^/2) + 2A^ exp(-iV72), 

where W{-) is a standard Wiener process and we used Lemmas 3.3 and 3.6 (with A: = 1). 

Hence (|4.7I1 follows by Borel-Cantelli lemma, and (14.8(1 follows from (14.7(1 by putting k = 1 there. 
To show ((4.9(1 . observe that 

pmpN)-mpt^)>j) = ^, 

since the event {(,{0,Pn) — ?(0, p^^) > j} means that the last j excursions out of A'" are downward 
and, looking at the random walk from backward, this event is equivalent to the event that the 
first j excursions are downward, which has the probability 1/2-^. Putting j = 21og A^, ((4.9p follows 
by Borel-Cantelli lemma. □ 

This also completes the proof of Proposition 1.3. □ 

Now we are ready to prove Theorem 1.1. Put N = ^(0, n) into ((1.20p . By Proposition 1.3 we 

have 

C{k, Kn) - m n) = Gik, e(0, n)) + O(fe5/^(e(0, a.s., (4.10) 

where = max{i < n : 5j = 0}, i.e., the last zero before n of the random walk and O is uniform 
for k G [1,(^(0, n)V/3-£-)^ 

Lemma 4.4 For any S > 0, as n oo, 

C{k,n) -C{k,Kn) = 0{kn^) a.s., (4.11) 



where O is uniform in k £ [l,n] 
Proof. We have 



C{k,n) - ^{k,Kn) < max {^{k, pi+i) - C{k, pi)), 

0<«<?(0,n) 
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therefore 



P( \J{^ik,n)-ak,^n)>kn'} 



<J2P\ max m,p^+l)-C{k,p,))>kn^ 



k=l 



, 0<j<5(0,n) 



n 

<P(e(0,n) >ni/2+^) + ^p( max Mk, p,+i) - C{k, p,)) > kn^ 



k=l 



, 0<i<ni/2+'5 
n 



< P(e(0, n) > + „i/2+5 J2 P{^{k, pi) > kn^). 

k=l 

Lemma 3.9 implies 

P(e(0,n) > 11^/2+5) < Cie-^^''^\ (4.12) 
Moreover, from the distribution of ^(A;,pi) (cf. Revesz [3Tj pp. 100, Theorem 9.7), we get 

Pm,Pi) >j) = ^(l- T^V"' < e'^/('''l (4.13) 



2k V 2k, 

Putting j = kn^ , (|4.11|) follows from (|4.12|) and (I4.13P by applying Borel-Cantelli lemma. □ 
To complete the proof of Theorem 1.1, observe that for any 6 > 0, almost surely 

for all n large enough. We have, as n ^ oo, 

(e(0,n))i/4+^/2 ^0(ni/8+5^/8) 

Now (I1.16P follows from (I4.10p and Lemma 4.4, since for large n the O term in (|4.10[1 is uniform in 

k G [1,71^/^-^), as stated. □ 



5 Proof of Theorems 1.2 and 1.3 

In this section we show that the local time ^(0, n) in (I1.16P can be changed to another random walk 
local time (,{0,n) and also to a Brownian local time ry(0, n), both independent of G{-, •), as claimed 
in Theorems 1.2 and 1.3, respectively. The method of proof is similar to that of [10], |11| . 
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5.1 Proof of Theorem 1.2 




Assume that on the same probabihty space we have two independent simple symmetric random 
walks {sl^\ i = 1,2,...} and {sl'^\ i = 1,2,...}, with respective local times and ^^^^(•,-)- 

Assume furthermore that the above procedure has been performed for both random walks, i.e. we 
have Wiener sheets W^^\-, •), W^'^\-, •) and Wiener processes W*^^\ satisfying Propositions 

1.1-1.3 and Theorem 1.1. Based on these two random walks, we construct a new simple symmetric 
random walk {Si, i = 1,2,...} such that its local time (,{0,n) will be close to ^^^^(0, n), while 
the increments i{k,n) — ^(0,n) will be close to ^^'^\k,n) — ^^^^(0, n). This is achieved by taking 
"large" excursions from S^^^ and "small" excursions from S'(^). As a result, we shall conclude that 
(,{k,n) — ,^(0,n) can be approximated by G^'^\k,(^^^\0,n)). 

This is done as follows (see [Hj). Let /9p\ j = 1, 2, i = 1, 2, . . . denote the consecutive return 
times to zero of the random walk S^^\ Let furthermore Nq = 0, Ni = 2^, ri = — N£^i = 2^^^, 
i = 1,2,..., and consider the blocks out of which the i-th block consisting of excursions as follows. 

..,S%\, i = l,2, ^ = 1,2,... 

In this block call an excursion large if 

U) _ U) ^ 4/3 

PNi_i+i PNi_i+i-l ^ '''t ' 

and call it small otherwise. Now construct the block 

of the new random walk, the £-th block having also excursions by keeping large excursions in 
the block of S^^^ unaltered and replacing small excursions of S^^^ by the small excursions of 5(2), 
keeping also the order of small and large excursions as it was in S^^^ . It is possible that there are 
more small excursions in the block of S'(^) than in the block of S^^). In this case replace as many 
small excursions as possible by those of S^^) , and leave the other small excursions unaltered in 5^^^ . 
One can easily see that, putting these blocks one after the other, the resulting 5i, ^2, . . . is a simple 
symmetric random walk. We denote by etc., without superfix, the corresponding quantities 
defined for this random walk, and continue with establishing the next five lemmas that will also 
lead to concluding Theorem 1.2. 

Lemma 5.1 The following inequalities hold: 

max \pi — p,-^^| (5.1) 

l<i<Ar/ * ' ^ ' 

j=l m=l i=l 
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and ^ 

max m,p^)-C^'Hk,pf'>)\<e{k) ^(;.a)+^(2))^ (5.2) 

l<i<Nf 

m=l 

where !{■} denotes the indicator of the event in the brackets, 



= max^max^ (C^^'^C^, P? V C^^'^l^, pS)) (5-3) 
and jim is the number of large excursions in the m-th block of S^^\ 



Proof. Obviously, maxi<j<]v^ \Pi~ P^i \ can be overestimated by the total length of small excursions 



of the two random walks up to time Ni which is the right-hand side of (|5.ip . 

Moreover, \^{k^pi) — C'-^H^) Pi^"*)! can be overestimated by the total number of large excursions 
up to Ni multiplied by the maximum of the local time of k over all excursions up to Ni of the two 
random walks, which is the right-hand side of (15. 2|) . □ 

Lemma 5.2 For n < we have 

max |e(0,i) -e(')(0,i)| < max |e(0,p,) -e(0,p5.'^)| +1. (5.4) 

Proof. Since ^{0,pj) = ^^'^\0,pf'^) = j, we have for pf}^ < i < pf\ j < N, 

e(o,i)-e(^)(o,i) <e(o,pf )-(j-i) 



On the other hand 



mpj) - mpj) + 1 < m.|x^ic(o,p,) - mpj)\ + 1- 



□ 



c(o,p,_i) -e(o,p;.i\) < m^ax^ie(o,p,) -e(o,pyoi + 1- 



Lemma 5.3 For C > 0, K = 1,2, . . . we have 

K 



pl^\J{^^^x^Uk,p,)-^^^){k,pfh > 3CkiV/'}^ 

^ E r 1 - TTT + exp(2(e - Syr'/^). (5.5) 



.k\ 2k 

k=l 
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Proof. Using (15.2(1 of Lemma 5.1, and 4 log 2 < 3, we get 



1/3 



P f U I max |e(A;,p,) -e(2)(A;,pf))| > ZCU 

\k=i u^*^^^ 

K / e 

< J2 nCik) > CklogN,) + KPiY^ (/xW + > 4£r 

k=l \m=l 

Using again the distribution of (,{k,pi) in [31], we get 

PiCik) > CklogNi) < 2NiP{C{k,pi) > CklogNe) 

Ni / 1 xC-'^iog^^ 
-~kV~2k) 

Moreover, {p.m , j = 1, 2, m = 1, 2, . . .} are independent random variables such that fim^ + fim^ 
has binomial distribution with parameters 2rm and pm = P{pi > rm^) < Vm^'^ ■, where Lemma 
3.10 was used for = 1. Using the moment generating function of the binomial distribution and 
exponential Markov's inequality, proceeding as in [11| . we get 

\m=l / m=l 

< exp I 2(e - 1) X! ^mPm ~ ^ I - exp(2(e - l)£ry^ - z). 

V m=l / 

Putting z = Mr^^, we get ([53]) . □ 
Lemma 5.4 yls ^ oo, 

=0(A:iV^/3log2iV) a.s., (5.6) 

where O is uniform in k £ [1, A^]- 

Proof. Applying the inequality (15.5(1 in Lemma 5.3 with K = N^, the right hand side is summable 
for i, provided that C is large enough. Hence 

max m,p^) - )| = OikiV/^) = 0{k{\ogN,fNl'^) 

almost surely, as ^ — > oo, from which ((5.6p follows. □ 
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To verify Theorem 1.2, we start from (ll.20p in Proposition 1.3, applying it for the random walk 
5(2). We have 

^^'Hk,P^N^)-^^'H0,P^N^) = G^^\k,N)+0{k'''N"'+^'^) a.s. 
as iV ^ cx). Since ^^^HO) Ptv'*) ~ H^^Pn) = ^, according to Lemma 5.4 we also have, as ^ oo, 

({k, Pn) - C(0, pn) = G^^^ {k, N) + 0(A;5/4Ari/4+£/2 ^ ^^i/3 ^^^2 
almost surely. Now put N = S^{0,n). Using Lemma 4.4, we can see as before, 

^{k, n) - e(0, n) = G(2) (A;, ^(0, n)) + 0{k^/\^/^+^'/^ + kn^/^+'/^) 

almost surely and uniformly in A; G [1, n^/^~^], as n ^ oo. It remains to show that on the right-hand 
side ^(0, n) can be replaced by ^(^)(0,n). 

Lemma 5.5 For any e > there exists a 6 > such that, as n ^ oo, 
where O is uniform in k G [l,n^/^^^]. 

Proof. Let < e < 1/6 and _Ke = [2^(i/6-e)]^ = 2^(V4-e/ioo) gj^^^g k-^/^W{k,-) is a standard 
Wiener process (denoted by W{-)), we have 



P I J <^ ma^ 



max |VF(2)(A;,^(0,n)) - W^'^^ {k,^^^\o,n))\ > k^/^m 



< K^P I ^ max ^ \W{i{<d,n)) - W{i^'> {<d,n)\ > 

V 2^ /I, 2 ^ 

< KiP{ sup |Ty(u) - W{v)\ > ue) 

{u,v)i^A 

+2KfP(^(0,2^) > 2^) 

+KeP ( max |e(0,n) -e^i)(0,n)| > 2^^'^/^-'/'^^A , 

\l<n<2* / 



where 



A = {iu,v) : 0<u<2\0<v<2^,\u-v\<2^^'/^-'/^^^}. 
First we estimate the last term. By Lemma 5.2 

P (^max^^ |e(0,n) - e^^Ho,n)| > 2^(^/2-^/48)^ 
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where 



< P max |e(0,p,) -e(0,p;.'))| > 2^(1/2-/48) _ i 

\^/^[2f{l/2+e/4)] - ^ y 

< P ( max 1^(0, i) - C(0,i)| > 2^(1/2-^/48) _ ^^j 

+P (p[2](v.+./4)] < 2^) + 2P (p[2.(i/2+./4)] > 2^(4/3+-)) 

+pf max >2^(i--/i2)V 
\^i<j<2'^{i/2+E/4) "^-^ I y 

P = {(i, j) : 1 < i < 2^3+.)^ 1 < j < 2W3+e) _ < 2'?(i-^/i2)}. 



Now we estimate the respective right-hand sides of the previous two inequahties term by term. 
Lemma 3.9 imphes 

P( sup \W{u) - W{v)\ > 2^(l/4-e/100)) 



and 



< C7^ 2^(1/2+^/48) (^_^^2^(./48~./50)^ 

P I max |C(0,i) -e(0,j)| > 2^(1/2-^/^8) - 1 ] 

< ^^2^(1/6+13^/24) (_C2(2^-/24 _ 2)J 



Observe that 
and 



P(e(0,2^) > 2^) = 
< 2^) = ^(?(^)(0,20 > 2^(1/2+^/4)) < ^^,-C.2-/^_ 



'[2<(l/2+e/4)] 

Prom Lemma 3.10 we have 

Finally, from (|5.1I1 of Lemma 5.1, Lemma 3.10 and Markov's inequality 

p{ max 1/5, -pS'^ I > 2^(1-^/12)^ 

yi<j<2<^(l/2+£/4) '^J j 

2 ^(l/2+e/4) 

m=l 
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^(l/2+e/4) 

< ^ V 2^(™-l)/3 < ^2^(-l/6+e/2) 

^ 2^(1-^/12) 2^ ^ - 
m=l 

Assembling all these estimations, we obtain 

P\ U ^max jW^(2)(A:,e(0,n))-M^(2)(A:,e«(0,n))| >fei/2 



< Ci22^/3exp (-C22^^(V48-i/50)j + C32^/6exp(-C22^^/2) 
+Ci2^(i/3-ii./24) (_c;2(2^-/24 _ 2)) + C2->''l\ 
Since all these terms are summable in by Borel-Cantelli lemma we have 

maX^^JW^(2)(^^^(Q^^)) _^(2)(^^^(l)(Q^^))| ^ Q(^l/22W4-e/100)) 

almost surely, as ^ — > oo, uniformly for k £ [1,2^^^/^"^)], i.e., 

\W^'^\k,^{0,n)) - iy(2)(^^^(i)(o,n))| = O(A:i/2j^i/4-e/i00) 

almost surely, as n ^ oo, uniformly for k G Similar estimations hold for the other terms 

of hence we have JSJ]) with 6 = e/100. □ 
Since the above estimations also imply 

almost surely, when n ^ oo, with S = e/48, on choosing ^(0, •) = ^^^^0,-), = G^^\-,-), the 

proof of Theorem 1.2 is completed as well. □ 

5.2 Proof of Theorem 1.3 

First, we give a coupling inequality for the invariance principle between random walk and Brownian 
local times at location zero. We use Skorokhod embedding as in ^14], i.e., given a standard Wiener 
process W{-) with its local time r]{-, •), define a sequence of stopping times {rj}^Q by tq = 0, 

Tn := inf{t : t > r„_i, \Wit) - T^(r„_i)| = 1}, n = 1, 2, . . . 

Then Sn = VF(r„), n = 0, 1, 2, . . . is a simple symmetric random walk. Denote by ^(•, •) its local 
time and by pi the return times to zero. Moreover, define 

7]i := 7?(0,rp,+i) -r?(0,rpj, 
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i.e., the Brownian local time between the i-th return to zero and next stopping time r. Then 
by Knight [27] the random variables r]i, i = 1,2, are i.i.d. having exponential distribution with 
parameter 1. There is no other contribution than rji to the Brownian local time 7?(0, •). Moreover, 
we have 

€(0,n) 



i=l 



< 



the error term being zero if Sn = W{Tn) 7^ 0. If 5^ = 0, then the last term ri^(o,n) is not counted in 
r/(0,r„). Now we have 



|e(0,n) -r/(0,n)| < |r/(0, r„) - ry(0, n)| + max 

l<J<5(0,n) 

Therefore, for (5 > 

P(|e(0,n) -r/(0,n)| > 2n^/^+^ + C7 log n) 



I 

i=l 



< P(?(0, n) > n^/2+'^) + P max 

1 l<j<„l/2+^ 



I 
1=1 



+P\ max rii>Clogn]+P(\Tn-n\>n^/'^+^) 

\l<j<nl/2+i / 



+P 



sup |r?(0, - ??(0, n)\ > n^/^+^ 

Ju-n|<ni/2+<5 



)• 



Estimating the above probabilities term by term, by Lemmas 3.9, 3.11 and 3.12, 
P(C(0,n) > ni/2+'5) < 



P 



max 

l<j<ni/2+'5 







j^im - 1) 




i=l 





P max T7i>Clogn <n^/2+^"^, 
P(|r„-n| >ni/2+^) <2e-3"'V8^ 



P 



sup 

J«-n|<nl/2+i 



Hence, we arrive at the coupling inequality for the invariance principle between random walk 
and Brownian local times 



P(|e(0,n) -??(0,n)| > 2n^/^+^ + Clog 



n 



(5.5 
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By choosing < 5 < 1/2 and C > 2, this also implies 

^(0, n) - r/(0, n) = 0(71^/^+^) a.s. (5.9) 

as n ^ oo. 

For the proof of Theorem 1.3 we apply the above procedure for ^^^HOr)) i-e-j we construct a 
standard Brownian local time 7/(0, •) satisfying the above inequality with ^ replaced by We may 
assume that ry(0, •) is also independent of G{-, •) of Theorem 1.2. We show that in (iv) of Theorem 
1.2, ^ = can be replaced by r] with the same O term. 

Lemma 5.6 As n ^ oo, we have for any 5 > 

where O is uniform in k G [l,n^/^]. 
Proof. Let = [n^/^]. 



pi y \w'-'^\k,C'^^\0,n))-W'-'^\k,r]{0,n))) > k^/\^/^+^ 
\k=l / 

< KnP{ sup \W{u) - W{v)\ > 72^/^+'^) + K„P(^(i)(0,n) > 
+KnP{r]{0,n) > 

+i^„P(|C(^) (0, n) - r/(0, n)\ > 2n^/^+^ + C log n), 



where 



D = {{u, v) : u < n 
Now using Lemma 3.9, we get the inequalities 

KnP I sup \W{u) - W{v)\ > n^/s+M < Cini/2e-c^2"', 

\iu,v)£D J 

KnP{C^'\0,n) > ni/2+^) < Cini/^e-^^"'', 

By choosing C large enough in (15.8(1 . the right-hand sides of that and also of the above inequalities 
are summable in n. Lemma 5.6 follows by Borel-Cantelli lemma. □ 

The same holds for other terms of G^'^\ Choosing 6 < e, the error term in Lemma 5.6 is smaller 
than kn in (iv) of Theorem 1.2, hence we have also (iii) of Theorem 1.3 with G = G^^), ^ = . 
(ii) of Theorem 1.3 follows from (15.9(1 with ^ replaced by = ^ and (iii) of Theorem 1.2. This 
completes the proof of Theorem 1.3. □ 
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